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A  METHODOLOGY  FOR  ESTIMATING  MISSION  RELIABILITY 


0 . 0  Introduction 

This  research  is  specifically  directed  towards  estimating 
vehicle  mission  reliability  where  data  is  generated  from  proving 
ground  or  actual  field  testing.  Ir.  proving  ground  testing  the 
mission  profile  is  assumed  to  be  an  accurate  representation  of 
field  usage.  Thus,  the  mission  reliability  estimate  will  be 
indicative  of  that  which  should  be  achieved  by  the  vehicle  in 
actual  use  conditions.  The  typical  vehicle  testing  situation 
which  is  the  basis  for  estimation  will  now  be  delineated. 

In  proving  ground  or  field  testing  there  is  normally  a  target 
test  bogy  which  is  a  specified  mileage  (or  kilometers)  for  the 
vehicle.  As  the  vehicle  traverses  the  proving  ground,  failures 
are  generated*.  This  situation  is  shown  pictorially  in  Figure  1, 
below.  The  vehicle  will  sometimes  not  exactly  meet  the  test  bogy 


Figure  1  Proving  Ground  Vehicle  Testing  Situation 


*Aclually,  failure  incidents  are  generated  which  are  subsequently 
scored  by  an  offical  Scoring  Commiftce. 
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due  to  the  randomness  associated  with  a  product  testing  program. 

This  testing  situation  is  analogous  to  a  random  variate 
generator  where  each  variate  (t^.)  is  generated  by  the  vehicle 
after  a  repair.  It  will  be  assumed  that  the  distribution  regen¬ 
erates  after  each  failure.  A  further,  and  more  complex,  approach 
would  be  to  assume  that  the  distribution  does  not  regenerate. 

Specific  approaches  to  mission  reliability  estimation  will 
be  adapted  to  this  testing  situation.  The  emphasis  was  to  develop 
and  present  easy-to-use  techniques  for  mission  reliability  estima¬ 
tion.  The  approaches  considered  in  this  report  are:  (i)  failure 
data  analysis,  (ii)  exponential  distribution,  and  (iii)  binomial 
distribution.  Application  of  each  technique  is  covered  in  the 
following  sections. 


2 


SECTION  I 


FAILURE  DATA  ANALYSIS  BASED  ON 
TOTAL  TIME  ON  TEST  PLOTS 


Failure  Data  Analysis  Bnsed  on 
Total  Time  on  Test  Plots 


1 . 0  Introduction 

In  order  to  compute  mission  reliability,  we  present  the 
adaptation  of  a  new  method  in  this  section.  The  methods  pre¬ 
sented  here  are  non-parametric  in  nature  in  the  sense  that 
they  do  not  assume  the  nature  of  the  underlying  failure  dis¬ 
tribution.  These  methods  are  based  on  the  concept  of  the 
total  time  on  test  transform.  The  mathematical  concept  of 
the  total  time  on  test  transform  was  introduced  in  Chapters 
5  and  6  of  reference  [3]*.  The  total  time  on  test  plot  is 
useful  in  choosing  a  probabilistic  model  in  terms  of  a  failure 
distribution  to  represent  the  failure  behavior  of  the  data. 

Thus,  by  using  the  methodology  presented  here,  the  reliability 
engineer  can  make  a  decision  regarding  which  failure  distribu¬ 
tion  "best"  represents  the  data.  The  approach  is  graphical  in 
nature  and  thus  is  very  easy  to  implement  in  the  Army's  environ¬ 
ment.  The  procedures  presented  will  help  the  reliability  en¬ 
gineer  to  plot  the  test  data  in  a  systematic  way  and  develop 
suitable  failure  models.  Once  a  decision  is  made  on  the  selec¬ 
tion  of  the  failure  model,  mission  reliability  can  be  easily 
computed . 

It  is  not  always  necessary  to  develop  the  failure  model. 
From  the  plots  presented  here,  a  hazard  function  can  be  easily 
developed  and  hence  using  the  knowledge  about  the  hazard 

*See  page  71. 
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function  we  can  easily  compute  the  mission  reliability.  The 
graphical  estimation  of  the  failure  rate  or  hazard  rate  function 
is  used  to  compute  the  mission  reliability.  The  methods  discussed 
here  can  analyze  incomplete  data.  The  total  time  on  test  plot 
has  a  theoretical  basis,  and  the  mathematical  theory  for  these 
plots  has  been  developed  [8],  These  plots  converge  to  a  trans¬ 
form  of  the  underlying  probability  distribution  as  the  sample 
size  increases. 
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2 . 0  Concept  of  the  Total  Time  on  Test  Transform 

Mission  reliability  of  a  military  system  is  evaluated  by 
testing  the  system  and  observing  the  times  when  failures  occurred. 
The  underlying  distribution  is  generally  not  known.  Hence, 
nonparametric  methods  will  be  of  tremendous  value  to  evaluate  the 
mission  reliability. 

In  order  to  develop  the  concept  of  the  total  Lime  on  test 
transform,  we  first  present  the  method  of  evaluating  reliability 
based  on  the  assumption  that  the  underlying  failure  distribution 
is  exponential  [See  also  page  47], 

Suppose  we  have  an  ordered  sample  from  an  exponential  dis¬ 
tribution 


f(t)  =  Ae 


-At 


,  t  >  0,  A  >  0 


or  f(t)  =  J  e"t/0  ,  t  >  0,  0  >  0 

where  A  =  ^  =  failure  rate 
and  G  =  mean  life  or  MTBF 

We  write  the  ordered  sample  as 


(1) 

(2) 


0  *  "nO  i  cnl  i 


Cnn 


(3) 


where  the  index  n  means  that  n  items  are  placed  on  test  and  in 
the  above  case,  we  observe  all  the  n  failures.  In  case,  we  only 
observe  r  failures  when  we  have  n  items  on  test,  then  the  ordered 
sample  will  be  written  as 


0=tn<t,<...<t 

nO  -  nl  -  -  nr 


(4) 


It  is  clear  that  the  total  time  on  test  is  the  sum  of  all 
observed  complete  and  incomplete  life  times  and  is  given  by 
T(t  )  "  total  t  imc  on  test  (a  fund  ion  of  tnr> 

=  n  ‘nl  4  <n-1><t'n2-tnl>  +  •••  +  (n-r+1 )  (t  nr- tn  ,  r- 1  > 
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(5) 


=ih  Cni  +  (n‘r)tnr 

Based  on  total  time  on  test,  we  can  estimate  0,  the  MTBF 
for  the  system.  It  is  well  known  [10,11,12]  that 


r,n 


=  -  T(t  ) 
r  v  nr' 


(6) 


is  the  maximum  likelihood  estimator  of  0  and  is  the  unique 


minimum  variance  and  unhinscd  esl  im.il  or  of  0  .  The  above  est  imifoi 
has  been  extensively  used  for  the  evaluation  of  .system  reliability 
and  the  development  of  confidence  bounds  with  the  associated 
mathematics  given  in  [14],  However,  it  must  be  remembered 
that  this  estimator  is  based  on  the  assumption  that  the  under¬ 
lying  failure  distribution  is  exponential. 

'Now,  we  present  the  development  of  the  concept  of  total  time 
on  test  where  the  underlying  distribution  is  not  known  and  is 
any  arbitrary  distribution.  Given  the  ordered  sample  information 
(Eq.  (3)),  the  empirical  distribution  for  the  underlying  arbitrary 
distribution  may  be  written  as 


F 

n 


(t)  = 


t  <  t 

nl 


tni  ±  C  1  tn , i+1 


t  '  t 


nn 


(7) 


The  use  of  the  above  empirical  distribution  is  well  known 
to  the  engineer.  Now,  we  develop  the  concept  of  total  time  on 
test  based  on  the  above  empirical  distribution  (See  Figure  1). 
Let  us  define 

F”1  (u)  =  inf{t|Fn(t)  >  u}  (8) 


7 


For  example,  if  ^  <  u  <  ^,  then  Fn"1(u)  =  t  2,  and  in  general  for 

i  i+1  . 

<  u  <  - ,  we  have 

n  n 

Fn1(u)  =  tn.i+l*  i  =  0,1,2 . n  -  1.  (9) 


Now,  let  us  compute  the  following  integral 


F~ 1  (— ) 
n  vn' 


F- 1  (— ) 
n  n 


(1  -  Fn(u))  du  = 


Fn(u)  du 


where  Fn(u)  =  1  -  Fn(u).  Using  eqs.  (7)  and  (9),  we  have 


F_1(-) 
*  n  vn' 


F  (u)  du  =  E  [1  -  ^ — — ]  [t  .  -  t  .  ,] 
n  j=1L  n  nj  n,  j-lJ 


—  E  (n-j  +  l)(t.-t  .  ) 

n  j=l  nJ  n,j-l' 


=  -  [n  tnl  +  <n-l)(tn2-tnl)  +...+  (n-r+1) 


(tnr-tn,r-l)] 


F~ 1 (-) 
«  n  n 


F  (u)  du  =  -  T(t  ) 
n  v  '  n  v  nr7 


The  last  equaiton  follows  from  eq.  (5).  Let  us  now  consider  the 

Y* 

limiting  case  when  n  ->«#  and  —  -*■  v.  In  this  case,  it  is  well 
known  that 


F'1^ 


lim  J  Fn  (u)  d  u  =  J" 


F_ 1 (v) 


F  (u)  d  u 


n  -*•  <© 


—  ►  v 
n 


(12) 


uniformly  in  v,(0  £  v  <  1),  Here  F(-)  is  the  underlying  failure 

distribution  function  and  the  above  statement  means  that  as  the 

sample  size  n  approaches  infinity,  the  empirical  distribution 

given  by  (7)  converges  uniformly  to  the  actual  distribution  F(). 
Let  us  define 

F_1  (v)  _ 

Hp  (v)  4  J  F  (u)  du  ,  0  <  v  <  1  (13) 

o 

as  the  total  time  on  test  tranform. 

For  any  distribution  function  F(t),  it  is  well  known  that 
F"1(l)_ 

Hp^(l)  =  F  (u)  du  =  expected  value  of  r.v.t.  (14) 

o 


Thus,  the  basic  relationship  between  the  total  time  on 
test  transform  given  by  (13)  and  total  time  on  test  T(t  )  given 
by  (5)  is 


Lim 


1 

n 


f'Lv) 

T<tnr)  -  J  F  (u)  du 


Hp1  (v) 


(15) 


n 

r 

n 


00 


v 


Let  us  consider  the  example  of  an  exponential  distribution. 
We  have 


G (t)  =  1  -  e'L/°  ,  t  >  0,  0  >  0 


(16) 
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Hence,  the  total  time  on  test  transform  is  given  by 


H~  1  (v) 
G 


o 


(u)  du 


du 


(v) 

0  d  G  (u) 


G~ 1 (v) 

=  9  J  d  G  (u) 


0  v  ,  0  <  v  <  1 


(17) 


And ,  we  have 


HG1(v)  =  0v 

- 1  ® 

Hg^v) 


0  <  v  <  1 


(18) 


Thus,  by  scaling  the  total  time  on  test  transform  by  its  mean,  the 
scaled  total  time  on  test  transform  is  transformed  into  a  45° 
line  on  the  interval  [0,1]. 


11 


2 . 1  Relationship  of  Total  Time  on  Test  Transform  to  Failure  Rate 


The  total  time  on  test  transform  is  related  to  the  failure 
rate  for  the  underlying  failure  distribution.  Let  us  remember 
that  the  failure  rate  or  hazard  rate  h(t)  is  given  by  [see  14] 


h(t) 


f(t) 

my 


...  f(t) 


l-R(t) 


=  i^. 

F  (t) 


(19) 

(20) 


and 


R(t) 


exp 


t 

J  h  (u)  d  u] 

o 


(21) 


Thus,  we  see  that  f(t),  F(t),  R(t)  and  h(t)  are  all  related 
to  each  other  and  the  knowledge  about  any  one  of  them  determines 
the  remaining  three.  Now,  we  observe  that 


F  (t) 


d  u 


v  =  F (t) 


1  -  v 
f [ F” 1 (v)  ] 


v  =  F (t ) 


1  -  F(t) 
f[F_1(F(t))] 


l-F(t) 

f(t) 


rfH” =  RTFy 


(22) 
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Thus,  the  rate  of  change  of  the  total  time  on  test  transform 
is  equal  to  one  divided  by  the  associated  failure  rate.  This 
means  that  if  we  have  a  plot  of  total  time  on  test  transform,  we 
can  estimate  the  failure  rate  from  it. 

If  the  underlying  failure  distribution  F  has  an  increasing 
failure  rate  (IFR) ,  i.e.  h(t)  increases  with  t,  then  the  rate 
of  change  of  Hp^(v)  is  decreasing  and  hence  Hp^(v)  is  a  concave 
function  in  v, (0  £  v  £  1).  On  the  other  hand,  if  the  underlying 
distribution  has  a  decreasing  failure  rate  (DFR) ,  i.e.  h(t) 
decreases  with  L,  then  Hp^(v)  is  a  convex  function  in  v, (0  £  v  <  1). 
This  property  about  the  nature  of  the  total  time  on  test  transform 
can  be  used  to  understand  the  behavior  of  the  failure  rate  for 
the  underlying  system.  This  will  give  us  an  idea  whether  the 
failure  rate  is  increasing  or  decreasing  during  a  certain  time 
period. 

From  eq.  (22),  it  is  also  clear  that  determines  F  if  F 
is  absolutely  continuous.  Since  absolutely  continvous  distributions 
are  dense  in  the  class  of  all  failure  distributions ,  we  see  that 
Hp  (v)  determines  F  in  general.  This  is  an  important  property 
because  it  tells  us  that  Hp^(v)  determines  F  and  we  can  use  the 
total  time  on  test  transform  for  identification  of  the  failure 
distribution  model  for  the  system. 

One  of  the  important  concepts  in  reliability  theory  is  the 
concepts  of  failure  rate  on  an  average.  A  failure  distribution 
F  is  said  to  have  increasing  failure  rate  average  (IFRA)  if  the 
cumulative  failure  rate  on  an  average  with  respect  to  time 
increase  with  time.  Thus,  the  distribution  F  is  IFRA  if 
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1 

t. 


(23) 


h(u)  du  +  t  >  0 


From  eq.  (21),  it  is  clear  that 


h(u)  du  =  -  In  R(t)  =  -  In  F(t) 


Hence,  we  can  restate  the  definition  that  distribution  F  has 

increasing  failure  rate  average  (F  is  IFRA)  if - “ - is 

increasing  (non-decreasing)  in  t  >  0.  Similarly,  F  has  decreasing 
failure  rate  average  (F  is  DFRA)  if  — ^ ^2.  is  decreasing 
(non-increasing)  in  t  >  0. 

Now  we  give  the  behavior  of  the  total  time  on  test 
transform  for  IFRA  and  DFRA  distributions.  If  failure  distribution 
F  is  IFRA  (DFRA),  than  HpX(v)/v  is  non-increasing  (non-decreasing) 
in  v,  0  <  v  <  1  and  H^1 (v) /H'1 (v)  lies  above  (below)  the  45°  line. 
The  proof  for  this  statement  is  as  follows. 

Let  F  be  IFRA  with  a  probability  density  function  f.  Then 
as  given  by  eq.  (23),  we  have  that 


I  / 


h(u)  du  t  t  >  0 


where  h(t)  =  - 

F  (t) 


Let  S(t)  =  J  F (u)  du,  then  S(t)/t  is  always  non- increasing 
in  t  >  0  be°cause  F (u)  is  always  non-increasing  in  t  >  0.  Also 

S(t)  =  Jo  F(u)du  f 2 5 ^ 


in  non- increasing  in  t  >0.  Let  v  =  F(t)  in  eq.  (25),  then 
then  we  have  that  Hp^(v)/v  is  non- increasing  in  v  >  0.  Similarly 

we  can  prove  the  result  when  F  is  DFRA. 
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3.0  Failure  Distribul ion  Mode l  Identification  Based  on  Total 
T i  me  on  Tc st  Trans  f o rm 

ll  was  pointed  out  in  the  last  seel  ion  that  I  lie  total  t  ime 
on  test  transform  Hp^(v)  determines  the  underlying  failure 
distribution  F.  We  also  showed  that  for  the  exponential  distri¬ 
bution,  if  we  plot  the  scaled  total  time  on  test  transform 
(eq.  (18)),  we  get  a  45°  line  on  the  interval  [0,  1].  Thus,  a 
45°  line  indicates  that  the  underlying  distribution  is  exponential. 
Similarly,  we  can  develop  relationships  for  other  distributions. 

For  the  Weibull  distribution,  we  have 

F (t)  =  1  -  exp[-(|)6]  ,  t  >  0  (26) 

where  6  >  0  is  the  shape  parameter  and  6  >  0  is  1  he  scale 
parameter  or  the  characteristic  life.  We  also  snowed  that 
(see  eq.  (14)) 

Hp^(l)  =  expected  life  for  Weibull  r.v. 

=  6  T(1  +  J)  (27) 

The  results  for  the  Weibull  distribution  are  given  in  references 
[14,17,18,24,  and  25].  In  this  case, 


H^Cv) 


(§>S]dt 


(28  > 


Based  on  eqs.  (28)  and  (27),  we  can  plot  the  scaled  total 
time  on  test  transforms  for  Weibull  distribution.  The  approx¬ 
imate  shapes  for  these  plots  for  different  values  of  the  shape 
parameter  8  are  given  in  Figure  2.  It  is  clear  that  the  plots 
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are  convex  which  means  that  we  have  decreasing  failure  rate 
for  3  <  1  and  concave  which  means  that  we  have  an  increasing 
failure  rate  for  3  >  1.  The  exponential  distribution  is  the  same  as 
3=1  and  hence  we  have  a  45°  line  as  proven  before. 

For  the  gamma  distribution,  the  probability  density  function 
is 


f(t)  =  ^  tn_L  e"At  ,  t  >  0,  n  >  0,  A  >  0  (29) 

where  n  is  the  shape  parameter  and  X  is  the  scale  parameter.  Also, 

Hp^(l)  =  expected  life  for  gamma  r.v. 

=  I  (30) 

Again,  for  the  gamma  distribution,  we  can  plot  the  scaled 
total  time  on  test  plots  as  given  in  Figure  3.  These  plots 
are  concave  functions  indicating  an  increasing  failure 
rate  for  n  >  1. 

For  the  lognormal  distribution,  we  have 

F(t)  ,  .[ULy_H]  (31) 

where  <t>  [•]  is  the  cumulative  distribution  for  the  standard 
normal  variable.  Again,  for  the  lognormal  distribution,  y  is 
the  scale  parameter  and  o  is  the  shape  parameter.  For  each 
o  >  0,  the  scaled  total  time  on  test  plot  crosses  the  45°  line 
at  most  once  from  above  and  the  approximate  shapes  for  these 
graphs  is  given  in  Figure  4.  The  abscissa  values  for  these 
cross-over  point  decreases  with  increasing  o  values.  Thus,  for 
some  values  of  o,  the  failure  rate  for  the  lognormal  distribution 
is  neither  always  an  increasing  failure  rate  nor  a  decreasing 
failure  rate. 
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on  Test  Transform  for 
ribution  (i\  is  the  shape  parameter) 


I 


The  approximate  shapes  of  the  total  time  on  test  plots  for  the 
trucated  normal  distribution  are  given  in  Figure  6.  lor  the  normal 
distribution,  we  always  have  an  increasing  failure  rate. 


•£»xf*r 


4.0  Total  Time  on  Test  Plots  Based  on  Test  Data 


In  this  section  we  are  going  to  explain  how  to  plot  the  total 
time  on  test  transform  when  we  have  test  data  for  the  system 
under  study.  The  plots  are  similar  to  the  scaled  total  time 
on  test  transforms  discussed  before.  These  plots  can  be  used 
to  identify  the  underlying  failure  distribution  based  on  the 
shape  of  the  plots  as  discussed  in  the  last  section.  The  plots 
may  also  be  used  to  evaluate  the  failure  rate  and  hence  the 
mission  reliability  by  using  the  relation 


(32) 


Model  identification  can  be  aided  by  the  use  of  transparent 
overlays  of  the  scaled  total  time  on  test  transforms  for  well 
known  distributions  such  as  the  Weibull,  lognormal,  normal,  gamma, 
etc.  We  are  going  to  discuss  the  plots  for  different  test 
data  situations. 
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4.1  Total  Time  on  Test  Plots  when  all  the  Failures  are  Observed 


tf  we  put  n  items  on  test  and  observe  all  the  failures, 
then  we  have  lest  data  as  I o I  I ows : 


0 


Cn0  -  '"nl  — 


<  t 
—  nn 


(33) 


Thus  all  the  observations  are  on  the  age  of  failure  of 

items  all  of  which  are  put  on  life  test  at  time  0.  Let  n(u) 

be  the  number  of  items  working  at  time  0  £  u  _<  t  .  Then  it  is 
clear  that 

T(t)  =  total  time  on  test  at  time  t 


/ 


n(u)  du 


(34) 


Actually  eq.  (34)  is  a  finite  sum  since  n(u)  is  a  step  function 
which  is  nonincreasing. 

Also,  remember  that  (from  eqs .  (13)  &  (15)) 

-1  A  ,F“1<V>-  1 

Hp  (v)  =  /  F(u)  du  *  i  T(tnj.)  (35) 


r* 

under  the  conditions  mentioned  before,  i.e.  n  -*-•  and  —  -+  v. 

’  n 

Thus,  we  plot 


T (t  .) 

T  ( t  ) 
nn' 


(36) 


i  1  o 

versus  n,  i  =  1,2 . n.  This  plot  is  a  function  on  L0,  ^ . 

1]  to  [0,  1]  and  hence  no  additional  scaling  is  necessary.  This 

scaled  total  time  on  test  plot  tends  to  look  like  the  plot  of 

scaled  total  time  on  test  transform  of  the  underlying  distribution, 

i.e. 
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Hp1 (v) 

-  for  0  <  v  1  (37) 

Hp1 (1) 

,  i 

as  n  •+  °°  and  —  -*■  v. 

n 

4.1.1  Example  (Based  on  example  10.1  in  reference  [14]) 

The  data  in  Table  1  represents  a  245  hour  vibration  simu¬ 
lation  test  on  a  half- ton  truck.  The  truck  was  shaken  on  a 
simulator  for  a  total  of  245  hours.  The  time  into  testing  at 
which  a  failure  occured  was  recorded. 


Table  1  -  Vibration  Simulation:  Failure  Time 
on  a  Half-Ton  Truck 


21.2 

74.7 

108.6 

157.4 

47.9 

76.8 

112.9 

164.7 

59.2 

84.8 

127.0 

196.8 

62.0 

91.0 

143.9 

214.4 

74.6 

93.3 

151.6 

218.9 

In  this  case  we  have  n  =  20  and  values  in  Table  1  are 

the  times  t  i  =  1,2,. ..,20.  Also  t  =  218.9.  Hence,  we 
ni  nn 

plot  T(t  .)/T(t  )  versus  —  for  i  =  1,2,...,  20.  The  values  for 

r  '  ni  nn  n 

the  plot  are  given  in  Table  2.  The  data  given  in  Table  2  is 
plotted  in  Figure  6.  The  statistical  test  given  in  reference 
[14]  based  on  which  the  above  example  is  constructed  concludes 
that  we  cannot  contradict  the  hypothesis  that  the  exponential 
distribution  can  be  used  to  model  the  time  to  failure  for  this 
system. 
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Table  2 

-  Values  for  Scaled 

Total  Time 

on  Test  Plot 

i 

T(t  . ) /T(t  ) 
m'  mr 

i 

T(tni)/T(t. 

1 

0.097 

11 

0.496 

2 

0.219 

12 

0.516 

3 

0.270 

13 

0.580 

4 

0.283 

14 

0.657 

5 

0.341 

15 

0.693 

6 

0.341 

16 

0.719 

7 

0.351 

17 

0.752 

8 

0.387 

18 

0.899 

9 

0.416 

19 

0.979 

10 

0.426 

20 

1.000 

The  scaled  total  time  on  test  transform  for  the  exponential 
distribution  is  a  straight  line  and  hence  we  would  expect  the 
scaled  total  time  on  test  plot  for  our  system  to  lie  close  to 
the  45°  line.  From  Figure  6,  it  is  clear  that  this  indeed  is 
the  case  and  the  plot  cruses  t  lie  45"  line  two  t  imos  Thus  the 
technique  of  total  time  on  test  plot  is  consistent  with 
statistically  validating  the  exponential  failure  model. 
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4.2  Total  Time  on  Test  Plots  with  Incomplete  Data 


One  of  the  important  features  of  the  total  time  on  test 
plots  is  that  we  can  evaluate  the  reliability  when  we  have 
incomplete  data.  Incomplete  data  may  be  due  to  time  truncated 
testing,  censored  data  or  the  failure  data  containing  with¬ 
drawals.  In  addition,  the  methodology  can  also  handle  grouped 
data.  For  all  of  these  situations,  we  are  going  to  present 
the  methodology  and  explain  how  to  plot  the  total  time  on  test 
graphs.  The  methodology  will  also  be  explained  by  the  help  of 
sample  problems  which  are  typical  of  the  military  situation 
when  testing  for  reliability  .  Test  situations  with  incomplete 
data  are  very  common  and  hence  it  is  important  to  have  a  method¬ 
ology  to  deal  with  this  situation.  There  are  several  reasons 
why  all  the  items  put  on  test  cannot  be  tested  to  failure  in¬ 
cluding  truncating  the  test  due  to  economic  reasons. 


4.2.1  Total  Time  on  Test  Plots  Based  on  Grouped  Data 

In  many  test  situations,  failures  are  recorded  in  terms  of 
number  of  failures  within  specified  time  intervals.  The  actual 
times  at  which  failures  occur  are  not  observed.  Let  us  define 
the  grid  on  the  time  axis  such  that  failures  are  observed  during 
each  interval.  Let  the  grid  be 


0  =  w«  <  w,  < 

U  ,n  1  ,n 


.  .  <  W.  <  W. , ,  < 

j ,n  J+l ,n 


(38) 


We  call  the  interval  [W.  ,  W. la  window  as  this  is  the 

J ,n’  j+l ,n  J 

(j+l)th  interval  during  which  failures  are  recorded  and  the  data 


i.«-  —  •trvr*-V. «»' 


j 

I 

» 

if 


#, 

f 

\ 

tf 


consists  of  total  number  of  failures  during  this  interval.  In 

each  window,  we  choose  a  point  ,  (perhaps  the  midpoint), 

3  >  ^ 

such  that  W.  <  £ .  <  W.,, 

j  ,n  -  ,n  J+l  ,n 

Let  (similar  as  defined  by  eq.  (7))  be  an  approximation 

to  the  empirical  distribution  defined  at  W.  and  •. .  for  i  =  1, 

l.n  1  ,n 

2,...,ni  where  m  is  the  minimum  index  such  that  all  windows  beyond 

W  have  no  observations, 
m ,  n 

Then,  using  eq.  (10),  we  observe  that  the  total  time  on 
test  plot  for  grouped  data  is  given  by 

k 


\l[Fn<Wk,n>J  E  ^ 


(39) 


As  n  ■*  ®  ,  we  can  prove  [3  ]  that  the  above  total  time  on 

test  transform  for  grouped  data  converges  uniformly  to  Hp1(t). 


4.2.  I .  I  lixamp  le 

We  are  interested  in  evaluating  the  reliability  of  a  sub¬ 
system  of  a  tank.  We  are  evaluating  the  reliability  based  on 
field  data  and  100  subsystems  were  monitored  for  failures.  We 
have  the  following  data 


Failures  of  a  Tank  Subsystem 


Table  3  - 

Kilometers 

I  •  1000 

1000  <  t  •  •'  2000 

2000  5  L  <  3000 
3000  <  t  <  4000 
4000  <  t  <  5000 
5000  <  t  <  6000 
6000  <  t  <  * 


Number  of  Failures 

1  1 
26 
28 
20 
14 
1 
0 

100 


*s 

i 


28 


Thus,  for  this  example  we  have  6  windows  or  subintervals 
during  which  failures  are  observed.  The  grid  is  uniform  because 
all  the  windows  are  of  equal  length.  The  approximation  of  the 


empirical  distribution  !■'  is 

1  n 

W, 

k  ,n 

F  (W,  ) 

n  k  ,n 

1,000 

0.11 

2,000 

0.  37 

3,000 

0.65 

4,000 

0.85 

5,000 

0.99 

6,000 

1.00 

Also,  if  we  use  the  midpoint 

of  each  window,  we  hav« 

^k,n 

Fn^k,n> 

500 

0.11 

1,500 

0.37 

2,500 

0.65 

3,500 

0.85 

4 , 500 

0 . 99 

5,500 

1  .00 

Hence,  using  eq.  (39),  we  can 

compute  the  following  table 

for  the  total  time  on  test  transform. 
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F  (W,  ) 

n'  k.rr 


H_1  (F  (W, 
n  n  1 


k  ,n 


)) 


0.11 

890 

0.37 

1,520 

0.65 

1  ,870 

0.85 

2,020 

0.99 

2,160 

1.00 

2,170 

We  also  know  that  Hn^(l)  is  equal  to  the  expected  life  for 
the  tank  subsystem  when  n  -*■  •  .  Hence,  the  scaled  total  time 
on  test  plot  can  be  developed  using  the  following  table. 

Hp1 (v) /Hp1 (1) 

0.41 
0.70 
0.86 
0.93 
0.99 
1 .00 

The  scaled  total  time  on  test  plot  using  the  data  in  the 
previous  table  is  given  in  Figure  7.  For  this  plot,  it  is  clear 
that  the  underlying  failure  distribution  has  an  increasing 
failure  rate  on  average  property.  This  distribution  may  also 
be  modeled  using  the  Weibull  or  gamma  distribution. 


0.11 

0.37 

0.65 

0.85 

0.99 

1.00 
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4. 3  Total  Time  on  Test  Plots  with  Truncated  Data 


For  several  test  situations,  testing  is  done  for  a  given 

period  and  is  terminated  at  some  point  in  time  T  If  we 

max 

had  n  items  on  test,  then  we  observe  r  <  n  failures  over  the 

interval  [0,  T  ].  Thus,  the  total  time  on  test  for  this 
max 

situation  is  (see  eq.  (34)) 


T(t)  =  /  n(u) 


du 


0  <  l 


max 


(40) 


For  this  situation  we  plot  T(tn^)/T(T^av)  versus  i  = 


max 


l,2,...,k.  For  this  we  have 

-1 

T(tni)  %  (vp) 

T^Tmax^  Hp^p) 


(41) 


as  n  -*■  <a  and  r-  v  where  p  =  F (T  ).  Hence,  total  time  on  test 

K  111 ci  X 

data  plots  should  be  compared  with  suitably  scaled  total  time 
on  test  transforms. 


4.4  Total  Time  on  Test  Plots  with  Censored  Data 


In  many  tost  si  lual  ion:;,  wo  place  n  i  I  inns  on  lost  and  stop 
the  test  as  soon  as  the  rth  (r  n)  failure  is  observed.  For  this 
situation  we  plot 


T(tni)  i 

-  versus  -  ,  i  =  1,2,... ,r 

T<tnr> 


The  underlying  limiting  convergence  for  this  case  is 


Ktni)  ^  H'^vp) 
T(tnr>  H”1  (p) 


(43) 


as  n  +  •  ,  —  •+  p  and  0  <  v  <  1. 

n  —  — 

Thus,  again  the  total  time  on  test  data  plots  should  be 
compared  with  suitably  scaled  total  time  on  test  transforms. 
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4. 5  Total  Time  on  Test  Plots  for  Failure  Data  Containing 

Withdrawals  or  Suspended  Items 

In  some  test  situations,  items  are  taken  off  of  test  for 
reasons  other  than  failure  [14].  For  instance,  a  test  may  be 
stopped  if  a  test  stand  breaks  down  or  a  test  vehicle  becomes 
involved  in  an  accident.  Or,  we  may  want  to  purposely  place 
more  items  on  test  than  we  intend  to  fail  in  order  to  decrease 
the  test  time.  In  this  section,  we  are  presenting  a  methodology 
to  handle  suspended  items  or  withdrawals  using  the  concept  of 
total  time  on  test  plots. 

Let  t^,  1 2 . tn  be  independent  random  variables  with 

distribution  F.  Suppose,  we  only  observe 


=  min  (t^,,  2^)  i  =  1,  2,...,  n  (44) 

where  2,^'s  are  constants.  If  t^  >  2^,  then  we  say  that  item  i 
was  lost  to  observation  at  time  2.^  or  the  item  was  suspended  at 
time  2.^.  Hence,  let 


0  =  t  <  t  ,  <...  <t, 
nO  -  nl  -  -  nk 


(45) 


be  the  observed  failure  times.  For  this  case,  the  total  time 
on  test  is  given  by  (using  eq.  (34)) 


T(tni)  =  /  ni  n(u)  du 

o 


(46) 


Hence,  we  plot 


T<tnl> 

T<tnk> 


i 

versus  £ 


i  =  1. 


(47) 
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For  this  situation,  the  model  identification  is  not  possible 
us  i  up,  I  he  sealed  lotal  lime  on  (esl  plots  for  well  known  dis¬ 
tributions  for  comparison.  However,  we  can  show  that  the  total 
time  on  test  plot  will  tend  to  lie  above  (below)  the  45°  line 
if  F  is  IFR(DFR) . 

4.5.1  Example 


Let  us  consider  an  example  of  failure  data  with  suspended 
items  as  given  in  reference  [14] .  We  put  10  items  on  test  but 
only  observe  six  failures  and  four  items  are  suspended  or  with¬ 
drawn  during  testing.  The  test  data  is  given  in  Table  4. 

Based  on  this  table,  the  ordered  six  failure  times  are 

544  <  663  <  897  <  914  <  1084  <  1099 

Hence,  the  total  time  on  test  are  given  in  Table  5.  The  table 
has  been  developed  using  Figure  8. 

Table  4  -  Suspended  Test  Data 


Hours  on  Test 

Status  of  It 

544 

Failure 

663 

Failure 

802 

Suspension 

827 

Suspension 

897 

Failure 

914 

Failure 

939 

Suspension 

1084 

Failure 

1099 

Failure 

1202 

Suspension 
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Total  Time 
on  Test 


Table  5 

-  Total  Time 

on  Test 

tni 

T (t  .) 
ni 

T<tni>',T<tnk> 

i/k 

544 

5440 

0.613 

0.166 

663 

6511 

0.734 

0.333 

897 

8218 

0.926 

0.500 

914 

8303 

0.936 

0.666 

1084 

8838 

0.996 

0.833 

1099 

8868 

1.000 

1.000 

(544) F 


if  (66  3)  F.. 


*  R02(S  ) 

*  827 (S2) 


*  897(F3) 


*  916 (F4) 

*  9  39(S.j) 


1084(1’’^) 

*  1099 (F.) 

D 

* ( 1 202) S. 


V  V 
5440  6511 


V  V 

8218  t 


8303  8868 


Figure  8  -  Total  Time  on  Test  Computation  for 
the  Suspended  Test  Data 


The  data  given  in  Table  5  is  plotted  in  Figure  9.  This  is 


the  scaled  total  time  on  test  plot  for  the  failure  data  with 
suspended  items.  Based  on  this  plot,  we  can  say  that  the  underlying 
failure  distribution  has  i  ne  reas  i  nj*  failure  rate  (ll'li). 


I 

T 

l 
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Figure 


5.0  Some  Important  Results  on  Total  Time  on  Test  Plots 


Let  the  observed  failure  times  with  or  without  censoring  be 

0  -  SiO  -  tnl  <  <  Lnk  (48) 

as  given  in  section  4.5.  If  the  underlying  failure  distribution 
is  exponential  as  given  by 


F (t)  =  1  -  e 


-t/e 


then  the  total  time  on  test  until  the  next  failure  is  given  by 


f^'nl  ft  n2  z-nk 

J  n (u)  du  ,  J  n (u)  du ,  ■■■  J  n(u) 


du  (50) 


n  ,k-l 


and  these  are  distributed  as  independent  random  variables  each 
with  the  exponential  distribution.  Let  us  make  an  assumption 
about  the  test  procedure  such  that  we  observe  at  least  k 
failures  when  n  items  were  put  on  test  at  time  t  =  0.  Let 
us  say  that  the  unit  i  has  age  a^  when  testing  commences.  It 
is  withdrawn  at  time  >  a^  if  it  does  not  fail  in  the  interval 

(a^,  ^i).  Let  JU  =  «•  ,  i  =  1,  2 . k  (1  <  k  <  n)  so  that  we 

observe  at  least  k  failures.  Under  this  assumption,  the  random 
variables  given  by  eq.  (50)  are  independent  and  exponentially 
distributed.  Let  us  define 


k-1 ,  i 


T<Lni> 

T<Cnk) 


i  =  1,  2 _ k-1 


Then  U,  ■,  are  distributed  as  (k-1)  order  statistics  from  a 
k-1 ,  l 

liform  distribution  on  [0,  l].  Hence, 


i  =  0,  1,  2... 


.  ,k-l 


(52) 


E[Uk_i 


i 

k 


and  sample  plots  tend  to  follow  the  45°  line  on  the  scaled 
total  time  on  test  graphs.  Since 


P[U 


n- 1 ,  i 


n 


]  -  i 


a  -  — )n* 

n 


*  1  -  e_1  <53) 

we  see  that,  under  exponent! ality .  the  plot  is  likely  to  lie 
with  probability  1  -  e  ^  0.632  initially  below  the  45°  line. 

If  we  have  infant  mortality  this  means  initially  a  DFR  distribution, 
and  we  would  of  course  expect  the  plot  to  initially  lie  below 
the  45°.  Now,  we  state  an  important  theorem  for  the  exponential 
distribution . 
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5 . 1  Theorem 


If  F  is  exponential  and  we  observe  n  failures  during  the  test, 

then 

P  {Total  Time  on  Test  Plot  lies  above  45°  line) 

=  P  {Total  Time  on  Test  Plot  lies  below  45°  line) 

=  I  (54) 

n 

Let  us  compute  the  probabilities  of  the  following  events 
associated  with  the  behavior  of  the  total  time  on  test  plots. 

Let 

E^:  The  plot  is  initially  below  and  finally  below  the  45°  line. 

E2:  The  plot  is  initially  below  and  finally  above  the  45°  line. 

Ey  The  plot  is  initially  above  and  finally  below  the  45°  line. 

E^:  The  plot  is  initially  above  and  finally  above  the  45°  line. 

Then  we  have  from  the  joint  density  of  U  ,  and  U  , 

J  J  nl  n,n-l 

P(E1}  =  (1  '  n)U  1  "  (1  ‘  l>n  1  *  °-23 

P(E2)  =  1  -  2(1  -  i)n-1  +  (1  -  |)n_1  0.4 

P(E3)  =  (1  -  |)n_1  -  (1  -  |)n_1  *0.14 

P(E4)  =  (1  -  £)n_1  -  (1  -  |)n_1  *  0.23 

Thus,  it  is  clear  that  the  event  E2  is  the  most  likely  of 
the  four  events  considered  above. 
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5 . 2  Concept,  o f  Sr oc h as ti c  Orde ring  an d  Its  Appl  i c a  ti on s  t  o 

Total  Time  on  Test  Plots 

It  is  important  to  provide  stochastic  comparisons  of  total 
time  on  test  processes  for  various  classes  of  distributions. 

A  stochastic  process  IX(l),  0  •  I  -  II  stochastically  dominate 
(*>")  a  process  iY(l),  0  *■'  t  II  if 

f[{X(t),  0  <  t  <  II]  S>  f  [  { Y(  t )  ,  0  <  t  <  11]  (55) 

s  t 

for  every  increasing  functional  f .  The  symbol  ( >  )  means 
stochastic  or  probability  ordering. 

Based  on  the  concept  of  stochastic  ordering  we  have  the 
following  result  which  can  be  used  for  stochastic  ordering  of 
total  time  on  test  plots. 

If  the  underlying  failure  distribution  is  IFRA  (DFRA) ,  then 
the  scaled  total  time  on  test  plot  stochastically  dominates  (is 
dominated  by)  corresponding  plots  based  on  an  exponential  distri¬ 
bution  of  the  same  sample  size.  We  stated  before  that 

(t) /Hp^ (1)  lies  above  (below)  the  45°  line  when  F  is  IFRA  (DFRA) 
Thus,  if  the  test  data  plot  lies  above  the  45°  line  we  should 
reject  an  exponential  model  in  favor  of  an  IFRA  (or  IFR)  model. 
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5 . 3  Analysis  of  Censored  Data  or  Data  with  Suspended  Items 

Model  identification  for  censored  data  is  very  difficult  and 

theoretical  results  are  not  available  at  the  present  time.  However, 

we  can  still  test  for  exponentiality  versus  alternative  models. 

It  is  clear  that  F™  <  F  for  all  continuous  F,  where 

1  * 

|  F(x)  ,  0  <  x  <  T 

Ft(x)  (56) 

i  1  ,  x  >  T 


Thus  the  scaled  total  time  on  test  plots  from  censored 
data  always  stochastically  dominated  scaled  total  time  on  test 
plots  from  complete  data  having  the  same  sample  size.  Similarly, 
Fp  £  F,  where 


F  (x)  --=  < 
P 


£  F<x) 


0  x  <  F  ~ 1  ( p ) 
x  >  F'l(p) 


and  p  =  — ,  so  that  again  the  total  time  on  test  plots  when 
observations  are  terminated  at  the  k  th  failure  dominate  scaled 
plots  from  complete  data  having  the  same  sample  size. 

Many  times  we  have  test  data  where  items  are  suspended. 

Thus,  the  test  data  indicates  that  the  i  th  item  survived  up  to 
time  and  after  that  it  was  suspended.  One  can  again  model 

this  situation  using  the  concept  of  stochastic  ordering  and 
prove  that  the  scaled  total  time  on  test  plot  for  suspended 
items  tends  tr  lie  above  the  scaled  total  time  on  test  plot  with¬ 
out  suspended  items. 
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6.0  Computation  of  Failure  Rate  &  Mission  Reliability 


In  Section  2.1,  we  proved  that 


& 


v  =  F(t) 


which  is  the  relationship  between  failure  rate  h(t)  and 
Hp^(v).  In  order  to  compute  empirically  the  failure  rate,  we 
consider  the  case  when  the  scaled  total  time  on  test  plots  are 
joined  by  straight  lines  as  shown  in  Figures  7  and  9.  Let 
0  =  Uq  <  u^  <  ...  <  u^  <  1  be  the  abscissa  values  of  endpoints  of 
linear  segments.  Then  the  successive  slopes  of  the  linear 
segments  denoted  by  a^,  •  •  •  >  ak+l  :''s  8*-ven  by 


ai  = 


-  Hn1<ui-l> 
<ui  -  "t-l>  Hn'<]) 


And,  using  eq .  (58),  it  is  clear  that  the  successive 

distribution  failure  rates  are  given  by 


Ai  = 


H  x  (1) 
n 


where  A^  is  the  failure  rate  for  the  i  th  linear  segment.  Thus, 
we  assume  that  we  have  a  constant  failure  rate  A^  in  the  interval 
t ^  ^  <  t  <  t ^  ,  i  =  0,  l,...,k.  In  order  to  compute  t ^ ,  we 

can  approximate  the  underlying  distribution  by  a  piecewise 
exponential  distribution  with  different  failure  rates.  The 
cumulative  failure  rate j A (t) I  estimate  at  the  time  tfc  is  given  by 


(61) 


A(t  )  —  E  A.  (t.  -  t.  ■.  ) 
r  i=l  1  1  1  1 


Hence , 


u  = 


F(tr) 


1  -  exp[-  £  A  .  (t .  -  t .  ,  )  ] 
i=l  11  1  1 


Thus,  t^'s  can  be  recursively  computed.  We  have 


tx  =  -[log  (l-u1)]/A1 


and  in  general 


r-1 


(62) 


(63) 


L r  *  [-  log(l-ur)  -  >i(<i  -  Li-1^/Ar  +  ^r-l 


After  we  have  computed  the  failure  rate  A^  for  the  interval 
t.  ^  <  t  <  we  can  compute  the  mission  reliability  for  any 
mission  of  duration  T  by  observing  that 


Mission  Reliability  =  R(T) 


i 

=  exp[-/  h(u)  du] 
o 

Hence,  eq.  (65)  can  be  approximated  by 


R(T)  =  exp[- .I  A.(t.  -  ti_1)  -  Ar+1(T  -  tr)] 


where  T  is  such  that  t  £  T  <  tr+^. 


(65) 


(66) 
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SECTION  T  I 


THE  EXPONENTIAL  DISTRIBUTION  AND 


MISSION  RELIABILITY  ESTIMATION 


THE  EXPONENTIAL  DISTRIBUTION  AND 
MISSION  RELIABILITY  ESTIMATION 


1.0  Introduction 

The  exponential  distribution  is  an  extremely  popular  and 
easy  to  use  distribution.  It  is  applicable  during  the  useful 
life  portion  of  a  vehicle  system  when  the  failure  rate  can  be 
assumed  to  be  constant.  Thus,  it  would  not  be  applicable  for 
extended  predictions  concerning  vehicle  durability. 

2.0  The  Basic  Statistical  Model 

The  p.d.f.  for  an  exponentially  distributed  random  variable 
t  is  given  by 

f(t)  =  l  e't/0  ,  t  >  0  (1) 

In  typical  vehicle  testing  the  quantity  t,  would  represent  the 
miles  (or  kilometers)  between  failures  (MMBF) .  The  parameter 
0  is  the  mean  miles  between  failure.  The  failure  rate  is  given 
by  A  where 

A  =  1/0  (2) 

The  shape  of  the  exponential  p.d.f.  is  shown  in  Figure  1.  In 
this  figure  R(t)  is  the  reliability.  Analytically  the  reliability 
function  is  calculated  by 

R(t)  =  e"t/G  ,  t  >  0  (3) 

Or,  using  the  failure  rate 

K(L)  e'M  ,  l-o  (4) 
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The  MMBF  for  the  exponential  distribution  is  given  by  the 
parameter  0.  The  chances  of  surviving  this  time  can  be  found 
from  equation  3.  Substituting  into  this  equation  gives 

R(6 )  =  e'1  =  0.368  (5) 

Or,  there  is  only  a  377,  chance  of  surviving  the  mean  life  when 
the  underlying  distribution  is  exponential. 

EXAMPLE  1 

The  mission  length  for  a  5-ton  truck  is  specified 
as  75  miles.  The  MMBF  is  2,150  miles.  Let  us  find  the 
mission  reliability. 

Using  equation  3  with  6  =  2,150  miles  we  find 
R(75  miles)  =  e-75/2,150  =  0  9? 
which  is  the  mission  reliability. 

EXAMPLE  2 

The  required  mission  reliability  for  an  armored 
personnel  carrier  is  0.92  with  a  mission  length  of  50  miles 
Assuming  an  exponential  time  to  failure  distribution  let's 
find  the  required  vehicle  MMBF. 

Using  equation  3  we  can  find  that 

0  "  tn/ln  d/V 

where  t^  is  the  required  mission  length  and  R^  is  the 
required  mission  reliability.  Substituting  into  equation 
6  we  find 
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0  =  50  mi les / In  (1/0.92) 


600  miles 


this  means  that  a  600  mile  MMBF  is  required  to  achieve 
the  desired  reliability  goal.  Or,  saying  this  another 
way,  the  mission  failure  rate  can  be  no  greater  than 

\  =  1/600  =  1.67  X  10  ^  failures/miles 

2.1  Goal  Setting  Using  Mission  Reliability 

Goal  setting  using  mission  reliability  rather  than  vehicle 
MMBF  can  be  dangerous  if  one  is  not  familiar  with  the  consequences 
Figure  2  illustrates  the  percent  improvement  needed  to  accomplish 
a  given  improvement  in  mission  reliability.  This  trade  off 
is  dependent  on  the  initial  reliability  level  of  the  vehicle. 

As  an  example  of  using  Figure  2  say  we  want  a  5/0  improvement 
in  mission  reliability.  If  the  initial  vehicle  mission  reli¬ 
ability  was  80%  the  required  increase  in  vehicle  MMBF  would  be 
28.5%.  It  should  be  recognized  that  such  a  large  change  in 
vehicle  MMBF  is  usually  extremely  difficult  to  accomplish. 

Note  also  that  if  the  vehicle  originally  had  a  0.90  mission 
reliability  the  required  increase  in  vehicle  MMBF  would  be  over 
507„,  which  is  impossible  to  accomplish  in  most  PIP  programs. 

2.2  Estimating  Mission  Reliab:1'  lity 

The  duration  of  testing  for  each  vehicle  is  normally 
specified  by  the  vehicle  developer.  Testing  is  then  carried 
out  at  a  designated  proving  ground.  In  life  testing  terminology 
this  is  Type  IT  (or  time)  censored  life  testing. 


rovement  in  Mission  Reliability 


2.2.1  Point  Estimate:  The  vehicle  MMBF  is  estimated  by 


g  _  Total  accumulated  test  miles  _  T 
Total  number  of  scored  failures  r 


(7) 


The  mission  reliability  is  then  estimated  as 


R  =  e"tm/0 


m 


(8) 


where  t  is  the  mission  length. 

2.2.2  Confidence  Limit  Estimate:  The  lower  100(l-cx)%  confidence 
limit  on  the  vehicle  MMBF  is  given  by 


2T 


a ,  2r+2 


0 


(9) 


where  T  is  the  total  accumulated  test  time  and  r  is  the  total 
number  of  scored  failures.  The  quantity  x2  2r+?  obtained 
from  a  chi-square  table  using  2r+2  as  the  degrees  of  freedom. 

A  convenient  approximation  based  on  the  normal  distribution 
is  given  by 


4T _ 

[za  +  v/4r+3]2 


<  o 


(10) 


where  z  is  a  standard  normal  variate  [  1  . 14].  This  approximation 
fairly  good  with  r  5  and  gets  better  with  increasing  r. 

Common  values  for  z.  are  listed  below. 


is 


52 


Table  I:  Standard  Normal  Variates 


Confidence  Level  (1-g) 

0  57. 

VOX 

807o 

707. 

5  OX 


Confidence  Factor  (z  ) 

I  .MS 
1.281 
0.841 
0.525 
0.0 


A  convenient  way  to  quickly  approximate  a  50X  confidence 
limit  is  given  by 

fTOTTS  i  a  (ID 

where  r  is  the  number  of  failures. 

The  100(l-a)7o  lower  confidence  limit  on  mission  reliability 
is  given  by 

-tm/L 

e  m  <  Rm  (12) 

where  L  is  the  100(l-a)7„  lower  confidence  limit  on  the  MMBF  as 
calculated  from  equations  9,  10,  or  11.  Of  course  t  is  the 
mission  length. 

A  50X  lower  confidence  limit  on  mission  reliability  is 
conveniently  approximated  by 


- t_(r+0 . 75) /T 


EXAMPLE  3 


Three  XM-1  tanks  were  each  scheduled  for  4,000  miles 
of  testing.  The  lest  produced  76  scored  mission  failures. 
Let's  estimate  the  mission  reliability. 

Using  equation  7  the  vehicle  MMBF  is  estimated  as 


ft  3  tanks  X  4,000  mi /tank  .. 

0  =  - *-7 — -p  -If - =  462  miles 

26  failures 


Assuming  a  mission  length  of  t  =  100  miles,  the  point 
estimate  of  mission  reliability  is  obtained  from  equation  8 
and  is 


r  -=  c-11/462 

in 


0.81 


The  507,  confidence  limit  is  calculated  from  equation  13 
and  is 


-100(26+0. 75)/12, 000 


0.80  <  R 

—  m 


2.3  Sequential  Testing 

Sequential  testing  allows  one  to  continually  assess 
vehicle  acceptance  on  a  day  by  day  basis.  As  soon  as  an 
accept  (or  reject)  decision  is  made  the  test  is  terminated. 
This  method  minimizes  testing  and  is  more  economical  and  fuel 
efficient.  However,  sequential  acceptance  tests  are  slightly 
harder  to  design. 
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Probability  of  Accepting  Vehicle 


The  parameter  that  determine  a  sequential  life  test  are 
'  I  .  '  ’  ( I  .  •  I  •*  I  ( ■  .  11  |  •  The  lei. it  ioiisliip  between  these  |  > .  1 1  .  line  I  e  is  is 

shown  in  Figure  3.  As  can  be  seen  in  this  figure  these  points 
determine  the  Operating  Characteristic  (O.C.)  curve  for  the  test 
Intermediate  points  on  the  O.C.  curve  can  be  calculated  from 
the  equation  in  Table  II  with  i  =  0.1  and/or  0.5. 


Table  II:  Calculation  of  Sequential  O.C.  Curve 
True  Value  of  MMBF  Probability  of  Accepting  Vehicle 


0 


6i  - 


e0  i 
l-Gr) 

ei 


0-j  -0Q 

i-CeV2) 

91°0 


(I-aS/o^-a1) 


0 


1 


1-6 


A  = 


B  = 


1-6 

a 


Once  the  O.C.  curve  is  decided  on, the  test  is  determined. 
In  order  to  set  up  the  test  boundaries  the  following  quantities 
must  be  calculated. 


b 


=  [ 


°0  fll 


1 

ln(01/0o) 


(14) 
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(15) 


*0  1 
hy  '  [o^]  ln<^ 


3, 


ln(t  L / 0 o ) 


(16) 


These  quantities  are  used  to  draw  the  sequential  life  testing 
graph  as  shown  in  Figure  4.  Both  lines  are  parallel  with  slope 
b.  This  graph  allows  monitoring  of  the  test  on  a  day  to  day 
basis  showing  the  results  visually. 


EXAMPLE  4 

A  10- ton  Hi-Mo  vehicle  must  demonstrate  an  MMBF  of 
2,500  miles  in  an  IP  test.  It  is  decided  to  use  a 
sequential  test  in  an  effort  to  minimize  fuel  consumption 
by  minimizing  testing. 

In  order  to  design  the  test  the  following  parameters 
are  selected 

6  =  0.20 

0^  =  2,500  miles 
a  =  0.10 
0Q  =  2,000  miles 

By  using  Table  II  with  i  =  0.5  an  intermediate  point  on 
the  O.C.  curve  is  calculated  as 
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Figure 


with  a  probability  of  acceptance  of  0.22.  The  resulting  O.C. 
curve  is  sketched  in  as  shown  in  Figure  5.  If  one  does  not 
like  this  O.C.  curve  then  the  parameters  must  be  changed. 

The  quantities  for  the  sequential  test  graph  are  found 
from  equations  14,  15,  and  16. 

In  this  case, 

b  =  4.48  X  10"^  failures /mile 
hy  =  20,794 
hx  =  6.740 

These  factors  can  now  be  used  to  construct  the  sequential  graph. 
This  is  easier  to  do  if  the  slope  is  expressed  as 

b  =  4-48  failures  ..  . 

10,000  miles 

The  points  hx  and  hy  are  scaled  off  on  the  x  and  y  axes  as 
shown  in  Figure  6.  Straight  lines  are  then  drawn  through  these 
points  using  the  slope  scale  as  determined  from  equation  17. 


SECTION  III 


THE  BINOMIAL  DISTRIBUTION  AND 
MISSION  RELIABILITY  ESTIMATION 
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THE  B [NOMIAL  DISTRIBUTION  AND 
MISSION  RELIABILITY  ESTIMATION 

1 . 0  Introduction 

A  vehicle  mission  is  a  precisely  defined  auantity  that  spe¬ 
cifies  such  things  as  ground  terrain,  vehicle  speeds,  weapon  usage, 
etc.  The  test  profile  can  be  looked  at  as  a  series  of  vehicle 
missions.  During  testing,  the  vehicle  either  succeeds  or  fails 
each  mission.  When  the  test  is  viewed  from  this  standpoint,  the 
binomial  distribution  can  be  used  to  determine  mission  reliability. 
2.0  Basic  Statistical  Model 

The  probability  model  for  this  situation  is 

P(y)  =  (")  V?  d-Rm)n'y  ,  y  =  0,  1,  2 . n  (1) 

where 

R  =  mission  reliability 
m 

n  =  total  number  of  missions  (completed  and  attempted) 
y  =  total  number  of  missions  successfully  completed 
The  quantity  p(y)  is  the  probability  of  completing  y  missions 
successfully  out  of  n  attempts.  This  is  the  well  known 
binomial  distribution. 

Example  1 

The  mission  reliability  for  an  armored  personnel 

carries  is  K  0.80.  T  f  *>  vehicles  are  sent  on  a  mission 
m 

what  is  the  probability  that  at  least  1  will  succeed? 

Here  we  want 

P (y  >  3)  =  p(y  =  3)  +  p (y  =  A)  +  p(y  =  5) 
which  is  the  probability  of  three  or  more  successes. 
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In  this  case, 


p(y)  =  (y)  0.8y  0 . 25_y 

and  for  example 

p(y  =  3)  =  0.8 3  0.2"  =  0.205 

Performing  similar  calculations  gives 
p(y  £  3)  =  0.943 

Or,  there  is  a  94.3%  chance  that  at  least  three  vehicles 
will  complete  the  mission. 


3.0  Mission  Reliability  Using  the  Binomial  Distribution 

3 . 1  Estimating  Mission  Reliability 


For  this  testing  situation  both  point  and  confidence  interval 
estimates  of  mission  reliability  can  be  obtained.  The  basic 
input  data  is  n,  the  number  of  missions  attempted  and  y,  the 
number  of  missions  successfully  completed. 

3.1.1  Point  Estimate:  The  point  esl  i inn to  or  mission  reliability 
is  obtained  by: 


(2) 


3.1.2  Confidence  Limit  Estimate:  An  exact  100(l-a)%  lower 
confidence  limit  on  the  reliability  is  given  by 


^  ”  y  +  (n-y+1)  ^  ,  2  (o-y+1)  ,  2y 


(3) 


where  F  0/  ,,N  0  is  easily  obtained  from  F-tables  [16].  ‘Iso 

u  ,2(n-v+l) ,2y  7 

recall  that, 

n  =  total  number  of  missions 
y  =  number  of  successful  missions 
The  F-tables  that  are  usually  available  are  somewhat  limited. 
Therefore,  it  is  convenient  to  have  an  approximation  for  the 
confidence  limit  that  uses  the  standard  normal  distribution. 

The  lower  confidence  on  mission  reliability  can  be  approximated  by 

(y-i) 


rl  = 


(4) 


=  the  standard  normal  variate  as  given  in 
Table  I,  below. 


65 


>7"Mf  »  wRsBMWwaaxr-f-* 


§4  s*>  -,.  sw^u4rsf*t:  ^ws1  •*•- 


Table  I:  Standard  Normal  Variates 


Confidence  Level  (1-ct) 

95% 

901 

801 

101 

501 


Confidence  Factor  (z  ) 

- i— <t— 


1.645 

1.281 

0.841 

0.525 

0.0 


Frequently  507o  confidence  limits  are  used  in  reliabi  lity 
work.  Note  that  the  50%  lower  confidence  limit  is  approximated 
by 

rl  ■  ^  <5> 


Example  2 

A  TOW  weapon  system  has  completed  a  test  schedule. 
The  test  is  equivalent  to  60  missions.  Dividing  the  test 
schedule  up  into  60  missions  results  in  seven  failed 
missions.  Let’s  estimate  the  mission  reliability. 

y  =  60  -  7  =  53  successful  missions 

out  of 

n  =  60  missions 

Then  the  point  estimate  for  mission  reliability  is 

Rm  ■  50  “  °'883 

The  lower  75%  confidence  level  is  found  from  equation  3, 
with 

F  -  1  31 

*0.25,  8,  106  - 
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substituting  into  the  equation  gives 


=  0.835 


Or,  the  75%  lower  confidence  on  mission  reliability  is 


0.835  <  R 
—  m 

If  equation  4  was  used  to  approximate  the  lower  limit, 
the  value  obtained  would  be 


RL  = 


60  +  0.675  /60(60-53+l) 

V — n - 


=  0.838 


As  can  be  seen,  this  approximation  provides  limits  that 
are  reasonably  close  to  the  exact  values. 

3.1.3  Bayesian  Confidence  Limits:  If  one  wants  to  use  a 
Bayesian  approach  slightly  higher  confidence  limits  will  result. 
The  Bayesian  100(l-u)%  lower  confidence  limit  on  reliability  is 
given  by 


_ (y+D _ 

(y+l)  +  (n-y+1)  Fa ,?(n-y+l) ,2<v+l) 


This  formula  was  developed  under  the  assumption  that  Rm  had 
an  equally  likely  chance  of  falling  anywhere  in  the  interval 
[0-1],  [See  16,  for  derivation].  Thus,  the  above  limit  might  be 
considered  a  conservative  Bayesian  limit. 


Example  3 


Reconsidering  example  2  with 


n  =  60 

y  -  53 
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A  Bayesian  limit  can  be  obtained.  The  required  F  value  is 


F0 . 25 ,  8.  108 


1.31 


Then  the  confidence  limit  is 


Or, 


5?T +“TFx173T5  _ 

0.837  <  R 

m 


837 
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3.2  Success  Testing 


In  planning  a  reliability  test  it  is  sometimes  helpful  to 
know  the  number  of  successful  missions  required  to  demonstrate 
a  minimum  reliability  at  a  desired  level  of  confidence.  The 
formulas  for  this  situation  will  now  be  given. 

For  the  special  case  where  y  =  0  (i.e.  no  failures),  the 
lower  100(l-a)7o  confidence  limit  on  the  reliability  is 

R  -  u1/n 
RL  "  a 

where 

a  =  the  level  of  significance 

n  =  the  sample  si y.e  (i.e.  number  of  missions) 

Then  with  100(l-<*)7.  confidence,  we  can  say  that 


where  R  is  the  true  mission  reliability, 
m 

If  we  let  C  =  1  -  a  be  the  desired  confidence  level  (i.e. 
0.80,  0.90,  etc.)  then  the  necessary  sample  size  to  demonstrate 
a  desired  reliability  level  is 

n  =  ln^~C)  (8) 

InR 

For  example,  if  a  mission  reliability  of  =  0.80  is  to  be 
demonstrated  at  907«  confidence  we  have 


.  ln(0.10) 
In (0.80) 


11 


Thus,  LI  missions  must  be  completed  with  no  failures, 
frequently  referred  to  as  success  testing. 


This  is 


■jr.-r-igg». 
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A  fuel  trailer  must  be  tested  to  demonstrate  that  it 
has  an  807,  mission  reliability  at  507,  confidence.  Let's 
determine  the  number  of  missions  it  must  complete  without 
failure  in  order  to  demonstrate  the  required  reliability. 
Substituting  into  equation  8  with 
C  =  0.50 
R  =  0.80 

gives 

In  0.50  _  t 
n  "  _  3 

Or,  three  successful  missions  are  required. 
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